Papers with two-stage method
Effective In-Context Example Selection through Data Compression (2024.findings-acl)
Copied to clipboard
| Challenge: | In-context learning has been validated in large language models, but the mechanism and selection strategy for in-cont example selection lacks systematic and in-depth research. |
| Approach: | They propose a data compression approach to select in-context examples using large language models. |
| Outcome: | The proposed method shows a significant improvement of 5.90% across five real-world datasets using four language models. |
Think Wider, Detect Sharper: Reinforced Reference Coverage for Document-Level Self-Contradiction Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent approaches to document-level contradiction detection (DSCD) only gain marginal improvement and often introduce inconsistencies across repeated responses. |
| Approach: | They propose a method that combines supervised fine-tuning and reinforcement learning to enhance document-level contradiction detection (DSCD) they propose to use a task-specific reward function to expand the model’s reasoning scope, boosting both accuracy and consistency. |
| Outcome: | The proposed method significantly boosts Llama 3.1-8B-Instruct’s accuracy from 38.5% to 51.1%, and consistency from 59.6% to76.2%. |
Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing taxonomies focus on adding concepts to the leaf nodes of the existing tree, which does not fully utilize the taxonomy’s knowledge and is unable to update the original taxomy structure. |
| Approach: | They propose a two-stage method called ATTEMPT for taxonomy completion that inserts new concepts into the correct position by finding a parent node and labeling child nodes. |
| Outcome: | The proposed method performs best on taxonomy completion and extension tasks, surpassing existing methods. |
PhraseCTM: Correlated Topic Modeling on Phrases within Markov Random Fields (P18-2)
Copied to clipboard
| Challenge: | Recent phrase-level topic models are unable to capture the correlation structure among the discovered topics. |
| Approach: | They propose a phrase-level topic model PhraseCTM and a method to find out the correlations of topics at phrase level. |
| Outcome: | The proposed method shows that correlated topic modeling is a good way to interpret themes of corpus. |
Universal Proposition Bank 2.0 (2022.lrec-1)
Copied to clipboard
Ishan Jindal, Alexandre Rademaker, Michał Ulewicz, Ha Linh, Huyen Nguyen, Khoi-Nguyen Tran, Huaiyu Zhu, Yunyao Li
| Challenge: | Semantic role labeling (SRL) is a shallow semantic parsing task that identifies "who did what to whom when, where etc." SRL is useful in a wide range of downstream NLP tasks and real-world applications. |
| Approach: | They propose a method to generate shallow semantic parsing tasks using monolingual SRL and multilingual parallel data. |
| Outcome: | The proposed method improves the quality of the generated propbanks. |
Event Transition Planning for Open-ended Text Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | Open-ended text generation tasks require models to generate coherent continuation given limited preceding context. |
| Approach: | They propose a novel two-stage method which explicitly arranges ensuing events in open-ended text generation tasks. |
| Outcome: | The proposed method improves coherence and diversity of open-ended text generation tasks. |
Contrastive and Consistency Learning for Neural Noisy-Channel Model in Spoken Language Understanding (2024.naacl-long)
Copied to clipboard
| Challenge: | End-to-end learning models require large volume of speech data with intent labels . however, models are sensitive to inconsistencies between training and evaluation conditions . |
| Approach: | They propose a module-based approach to learn intent in a noisy-channel model . they correlate error patterns between clean and noisy ASR transcripts . |
| Outcome: | The proposed method outperforms existing methods and improves in noisy environments. |
DICE: Structured Reasoning in LLMs through SLM-Guided Chain-of-Thought Correction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) often prioritize reasoning over adherence to detailed instructions due to high computational costs and limited parameter access. |
| Approach: | They propose a lightweight framework that guides small language models to refine LLMs’ outputs through chain-of-thought correction. |
| Outcome: | The proposed framework improves the average format accuracy and content correctness of LLM outputs by 35.4% and 29.4%, respectively, achieving state-of-the-art (SOTA) performance over other competitive baselines. |
Entailment Graph Learning with Textual Entailment and Soft Transitivity (2022.acl-long)
Copied to clipboard
| Challenge: | Typed entailment graphs suffer from severe sparsity and unreliability of distributional similarity . enlargement relation is critical to semantic understanding and natural language inference . |
| Approach: | They propose a method to learn local entailment relations by recognizing textual enanglement between template sentences formed by typed CCG-parsed predicates. |
| Outcome: | The proposed method can model transitivity in entailment graphs to alleviate sparsity and improve performance over current methods. |
HellaSwag-Pro: A Large-Scale Bilingual Benchmark for Evaluating the Robustness of LLMs in Commonsense Reasoning (2025.findings-acl)
Copied to clipboard
Xiaoyuan Li, Moxin Li, Rui Men, Yichang Zhang, Keqin Bao, Wenjie Wang, Fuli Feng, Dayiheng Liu, Junyang Lin
| Challenge: | Existing studies show that large language models are robust in commonsense reasoning . however, some variations in questions can lead to incorrect responses . |
| Approach: | They propose a large-scale bilingual benchmark consisting of 11,200 cases . they conduct extensive experiments on 41 representative LLMs . |
| Outcome: | The proposed benchmark systematically evaluates the robustness of large language models in commonsense reasoning. |
SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment (2025.coling-main)
Copied to clipboard
Yuchun Fan, Yongyu Mu, YiLin Wang, Lei Huang, Junhao Ruan, Bei Li, Tong Xiao, Shujian Huang, Xiaocheng Feng, Jingbo Zhu
| Challenge: | Large language models (LLMs) have demonstrated significant improvements in reasoning abilities, but these improvements are primarily focused on English, leading to inferior performance in non-English scenarios. |
| Approach: | They propose a multilingual reasoning alignment approach that fine-tunes the layers responsible for multilingual comprehension in one stage. |
| Outcome: | The proposed method fine-tunes 6 of the 9 layers responsible for multilingual comprehension, while reducing training time by 4.1-11.9 compared to the two-stage method. |
CARE-STaR: Constraint-aware Self-taught Reasoner (2025.findings-acl)
Copied to clipboard
Zhiliang Li, Bo Tang, Yijun Niu, Beihong Jin, Qiwen Shi, Yuchen Feng, Zhiyu Li, Jie Hu, Mingchuan Yang, Feiyu Xiong
| Challenge: | Recent research on instruction following has demonstrated that LLMs can handle complex instructions. |
| Approach: | They propose to assign constraints to different levels of constraints in instructions . they use chain-of-thought and self-taught reasoner methods to identify constraints . |
| Outcome: | The proposed method outperforms supervised fine-tuning (SFT) on three instruction-following benchmarks. |
Synthetic Data Generation for Training Diversified Commonsense Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing Generative Commonsense Reasoning datasets are created using a small number of human annotators, covering only a narrow set of commonsense scenarios. |
| Approach: | They propose to use a synthetic dataset to train diverse commonsense generators. |
| Outcome: | The proposed model improves both generation diversity and quality compared with vanilla models and human-crafted datasets across different size Large Language Models (LLMs). |